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1 Introduction 

The use of discrete optimization (DO) models and algorithms makes it pos- 
sible to solve many practical problems in scheduling theory, network opti- 
mization, routing in communication networks, facility location, optimization 
in enterprise resource planning, and logistics (in particular, in supply chain 
management [36]). The field of artificial intelligence includes aspects like the- 
orem proving, SAT in propositional logic (see [53], [50]), robotics problems, 
inference calculation in Bayesian networks [66] . scheduling, and others. 

Many real- life DO problems contain a huge number of variables and/or 
constraints that make the models intractable for currently available DO 
solvers. A^P-hardness refers to the worst-case complexity of problems. Recog- 
nizing problem instances that are better (and easier for solving) than these 
"worst cases" is a rewarding task given that better algorithms can be used for 
these easy cases. 

Complexity theory has proved that universality and effectiveness are con- 
tradictory requirements to algorithm complexity. But the complexity of some 
class of problems decreases if the class may be divided into subsets and the 
special structure of these subsets can be used in the algorithm design. 

To meet the challenge of solving large scale DO problems (DOPs) in 
reasonable time, there is an urgent need to develop new decomposition ap- 
proaches [52] , [55] , [75] . Large-scale DOPs are characterized not only by huge 
size but also by special or sparse structure. The block form of many DO 
problems is usually caused by the weak connectedness of subsystems of real 
systems. One of the first examples of large sparse linear programming (LP) 
problems which Dantzig started to study was a class of staircase LP prob- 
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lems for dynamic planning [37] , [35] , [25] . Further examples of staircase linear 
programs (see Fourer [15]) for multiperiod planning, scheduling, and as- 
signment, and for multistage structural design, are included in a set of stair- 
case test problems collected by Ho & Loute [57] . Staircase linear programs 
have also been derived in connection with linearly constrained optimal control 
and stochastic programming [103j . Problems of optimal hotel apartments as- 
signment, linear dynamic programming, labor resources allocation, control on 
hierarchic structures (usually having tree- like structure), multistage integer 
stochastic programming, network problems may be considered as examples of 
DO problems which have staircase structure (see [89], [90]). The well known 
SAT problem stems from classical investigations by logicians of propositional 
satisfiability and has over 90 years of history. It is possible to represent a SAT 
problem as a sparse DO problem 58J . Some applied facility location problems 
can be formulated as set covering problems, set packing problems, node pack- 
ing problems [75] . Another class of sparse DO problems is a production lot- 
sizing problem [73 . The frequency assignment problem (FAP) [65] in mobile 
telephone systems communication is a hard problem as it is closely related to 
the graph coloring problem. One of the well known decomposition approaches 
to solving DOPs is Lagrangean decomposition that consists of isolating sets 
of constraints to obtain separate and easy to solve DO problems. Lagrangean 
decomposition removes the complicating constraints from the constraint set 
and inserts them into the objective function. Most Lagrangean decomposi- 
tion methods deal with special row structures. Block angular structures with 
complicating variables and with complicating variables and constraints can be 
decomposed using Benders decomposition [13] and cross decomposition 99j. 
The Dantzig- Wolfe decomposition principle of LP has its equivalent in integer 
programming 98 . This approach uses the reformulation that gives rise to an 
integer master problem, whose typically large number of variables is dealt with 
implicitly by using an integer programming column generation procedure, also 
known as branch-and-price algorithm 9 that allows solving large-scale DOPs 
in recent years. Nemhauser ([73], P- 9) mentioned, however, that 

... the overall idea of using branch and bound with linear programming 
relaxation has not changed. 

Usually, DOPs from applications have a special structure, and the matrices 
of constraints for large-scale problems have a lot of zero elements (sparse ma- 
trices). Among decomposition approaches appropriate for solving such prob- 
lems we mention poorly known local decomposition algorithms using the spe- 
cial block matrix structure of constraints and half-forgotten nonserial dy- 
namic programming algorithms (NSDP) (Bertele & Brioschi [14], [15], 
[15] . Dechter [31], [32, [33], [33], Hooker [55]) which can exploit sparsity 
in the dependency graph of a DOP and allow to compute a solution in stages 
such that each of them uses results from previous stages. 

Recently, there has been growing interest in graph-based approaches to 
decomposition [19]; one of them is tree decomposition (TD). COURCELLE 



Local Elimination Algorithms 3 



[2"5] and Arnborg et al. [5] showed that several A^P-hard problems posed 
in monadic second-order logic can be solved in polynomial time using dy- 
namic programming techniques on input graphs with bounded treewidth. 
Thus graph-based decomposition approaches have gained importance. Graph- 
based structural decomposition techniques, e.g., nonserial dynamic program- 
ming (NSDP) (Bertele, Brioschi [16], Esogbue & Marks [37], Hooker 
[58] . Martelli & Montanari [68], Mitten & Nemhauser [71], Neumaier & 
Shcherbina [76], Rosenthal [86], Shcherbina [91]), Wilde & Beightler 
jlOlj and its modifications (bucket elimination [35], Seidel's invasion method 
[87]), tree decomposition combined with dynamic programming [35], [21j and 
its variants [77] , hypertree [47] and hinge decomposition [60] , [49] are promis- 
ing decomposition approaches that allow exploiting the structure of discrete 
problems in constraint satisfaction (CS) [43] and DO. 

It is important that aforementioned methods use just the local informa- 
tion (i.e., information about elements of given element's neighborhood) in a 
process of solving discrete problems. It is possible to propose a class of lo- 
cal elimination algorithms as a general framework that allows to calculate 
some global information about a solution of the entire problem using lo- 
cal computations [62j , [66] , [95] . Note that a main feature in aforementioned 
problems is the locality of information, a definition of elements' neighborhoods 
and studying them. 

The use of local information (see |104j . [105] . [39] . [94] . [97] ) is very impor- 
tant in studying complex discrete systems and in the development of decom- 
position methods for solving large sparse discrete problems; these problems 
simultaneously belong to the fields of discrete optimization [73] , [10] , [75] , [79] , 
[88] , artificial intelligence [32] , [48] , [72] , [81] , and databases [10] ■ In linear al- 
gebra, multifrontal techniques for solving sparse systems of linear equations 
were developed (see [85]); these methods are also of the decomposition nature. 
In [104] . local algorithms for computing information are introduced. A local 
algorithm A examines the elements in the order specified by an ordering algo- 
rithm An, calculates the function <f> whose value at each step determines the 
form of the information marks, and labels the element using local information 
about the elements in its neighborhood. The function (f> that induces the al- 
gorithm depends on two variables: the first ranges over the set of all elements 
and the second ranges over the set of neighborhoods. Local decomposition 
algorithms (see [HI], [20]) m DO problems have a specific feature. Namely, 
rather than calculating predicates, they use Bellman's optimality principle 
[12] to find optimal solutions of the subproblems corresponding to blocks of 
the DO problem. A step of the local algorithm 21 changes the neighborhood 
and replaces the index p by p + 1 (however, one can increment the index by 
an arbitrary number replacing S p by S p + P ; at each step of the algorithm, for 
every fixed set of variables of the boundary ring, the values of the variables of 
the corresponding neighborhood are stored, which is an important difference 
of the local algorithm 21 from A: information about variables in the solutions 
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of the subproblems is stored rather than information about the predicates. 
Zhuravlev proposed to call it indicator information. 

Tree and branch decomposition algorithms have been shown to be effective 
for DO problems like the traveling salesman problem 24J, frequency assign- 
ment [65] etc. (see a survey paper [55]). A paper [4] surveys algorithms that 
use tree decompositions. Most of works based on tree decomposition approach 
only present theoretical results [61] , see the recent surveys [55] , [92] • Thus these 
methods are not yet recognized tools of operations research practitioners. 

Some implementations of NSDP are known [TH] , [35] , however, generally, 
it remains some "obscure" tool for operations research modellers. Usually, 
tree decomposition approaches and NSDP are considered in the literature 
separately, without reference to the close relation between these methods. We 
try to indicate a close relation between these methods. 

A need to solve large-scale discrete problems with special structure using 
graph-based structural decomposition methods provides the main motivation 
for this chapter. Here we try to answer a number of questions about tree 
decomposition and NSDP in solving DO problems. What are they? How and 
where can they be applied? What consists a connection between different 
structural decomposition methods, such as tree decomposition and nonserial 
dynamic programming? 

The aim of this paper is to provide a review of structural decomposition 
methods and to give a unified framework in the form of local elimination 
algorithms [94]. We propose here the general approach which consists of 
viewing a decomposition of some DO problem as being represented by a DAG 
whose nodes represent subproblems that only contain local information. The 
nodes are connected by arcs that represent the dependency of the local infor- 
mation in the subproblems. A subproblem that is higher in the hierarchy may 
use the information (or knowledge) obtained in the dependent subproblems. 

This paper is organized as follows: In section[2]we introduce local elimina- 
tion algorithms for solving discrete problems. In Section[3]we survey necessary 
terminology and notions for discrete optimization problems and their graph 
representations. In Section [4] we consider local variable elimination schemes 
for solving DO problems with constraints and discuss a classification of dy- 
namic programming (DP) computational procedure. Elimination Game is in- 
troduced. Application of the bucket elimination algorithm from CS to solving 
DO problems is done. Then, in Section[5] we consider a local block elimination 
scheme and related notions. As a promising abstraction approach of solving 
DOPs we define clustering that merges several variables into a single meta- 
variable. This allows us to create a quotient (condensed) graph and apply a 
local block elimination algorithm. In Section [6] a tree decomposition scheme is 
introduced. Connection of of the local elimination algorithmic schemes with 
tree decomposition and a way of transforming the DAG of computational local 
elimination procedure to tree decomposition are discussed. 
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2 Local elimination algorithms for solving discrete 
problems 

The structure of discrete optimization problems is determined either by the 
original elements (e.g., variables) with a system of neighborhoods specified 
for them and with the order of searching through those elements using a lo- 
cal elimination algorithm or by various derived structures (e.g., block or 
tree-block structures). Both original and derived structures can be specified 
by the so called structural graph. The structural graph can be the inter- 
action graph of the original elements (for example, between the variables of 
the problem) or the quotient |45j (condensed [51j ) graph. The quotient 
graph can be obtained by merging a set of original elements (for example, 
a subgraph) into a condensed element. The original subset (subgraph) that 
formed the condensed element is called the detailed graph of this element. 
A local elimination algorithm (LEA) 94j eliminates local elements of the prob- 
lem's structure defined by the structural graph by computing and storing local 
information about these elements in the form of new dependencies added to 
the problem. Thus, the local elimination procedure consists of two parts: 

A. The forward part eliminates elements, computes and stores local solu- 
tions, and finally computes the value of the objective function; 

B. The backward part finds the global solution of the whole problem using 
the tables of local solutions; the global solution gives the optimal value 
of the objective function found while performing the forward part of the 
procedure. 

The LEA analyzes a neighborhood Nb(x) of the current element x in the 
structural graph of the problem, applies an elimination operator (which 
depends on the particular problem) to that element, calculates the function 
h(Nb(x)) that contains local information about x, and finds the local so- 
lution x* (Nb(x)). Next, the element x is eliminated, and a clique is created 
from the elements of Nb(x). The elimination of elements and the creation of 
cliques changes the structural graph and the neighborhoods of elements. The 
backward part of the local elimination algorithm reconstructs the solution of 
the whole problem based on the local solutions x* (Nb(x)). 

The algorithmic scheme of the LEA is a DAG in which the vertices cor- 
respond to the local subproblems and the edges reflect the informational de- 
pendence of the subproblems on each other. 

3 Discrete optimization problems and their graph 
representations 

3.1 Notions and definitions 

Consider a sparse DOP in the following form 
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F(x 1 ,x 2 ,...,x n ) = fk(X k ) ->max (1) 

keK 

subject to the constraints 

gi (X Si ) RiO, i£ M = {l,2,...,m}, (2) 
Xj G Dj, j eN = {!,.. .,n}, (3) 

where 

X {xi , ■ • • , x n } is a set of discrete variables, X k C {xx,x 2 , . ■ ■ ,x n }, k G 
K = {1, 2, . . . , t} , t - number of components in the objective function, S, C 
{1, 2, . . . , n}, i?i 6 {<, =, >}, i G M; Dj is a finite set of admissible values 
of variable Xj, j £ N. Functions fk(X k ), k E K are called components of 
the objective function and can be defined in tabular form. We use here the 
notation: if S — {ji, . . . , j q } then X$ = {xj x , . . . , Xj q }. 

In order to avoid complex notation, without loss of generality, we consider 
further a DOP with linear constraints and binary variables: 

max/(X) = max^/ fe (X fc ), (4) 

keK 

subject to 

A iSi X Si < h, i g M = {1,2,..., m}, (5) 
^• = 0,1, iGJV = {l,...,n}. (6) 
We shall consider further a linear objective function ||7J): 

n 

f(xi, ...,x n ) = f(X) = C N X N = 22 c i x i -* max ( 7 ) 

3=1 

Definition 1. [161. Variables x G X and y £ X interact in DOP with con- 
straints ( we denote x ~ y) if they both appear either in the same component of 
the objective function, or in the same constraint ( in other words, if variables 
are both either in a set X k , or in a set Xs^). 

Introduce a graph representation of the DOP. Description of the DOP struc- 
ture may be done with various detailization. The structural graph of the DOP 
defines which variables are in which constraints. Structure of a DOP can be 
defined either by interaction graph of initial elements (variables in the DOP) 
or by various derived structures, e.g., block structures, block-tree structures 
defined by so called quotient (condensed or compressed [7], [8], [54]) graph. 

Concrete choice of a structural graph of the DOP defines different local 
elimination schemes: nonserial dynamic programming, block decomposition, 
tree decomposition etc. 

If the DOP is divided into blocks corresponding to subsets of variables 
(met a- variables) or to subsets of constraints (meta-constraints), then block 
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structure can be described by a structural quotient (condensed) graph, whose 
meta-nodes correspond to subsets of the variables of blocks and meta-edges 
correspond to adjacent blocks (see below, in section I5TT]) . 

An interaction graph [TB] (dependency graph by HOOKER [5"B] ) 
represents a structure of the DOP in a natural way. 

Definition 2. [16]. Interaction graph of the DOP is an undirected graph 
G = {X, E), such that 

1. Vertices X of G correspond to variables of the DOP; 

2. Two vertices of G are adjacent iff corresponding variables interact. 

Further, we shall use the notion of vertices that correspond one-to-one to 
variables. 

Definition 3. Set of variables interacting with a variable x £ X is denoted 
by Nb{x) and called the neighborhood of the variable x. For corresponding 
vertices a neighborhood of a vertex x is a set of vertices of interaction graph 
that are linked by edges with x. Denote the latter neighborhood as Nb G (x). 

Introduce the following notions: 

1. Neighborhood of a set S C X, Nb G {S) = \J xeS Nb G (x) - S. 

2. Closed neighborhood of a set S C X, Nb G [S] = Nb G (S) U S. 

4 Local variable elimination algorithms in discrete 
optimization 

4.1 Nonserial dynamic programming and 
classification of DP formulations 

NSDP exploits only local computations to solve global discrete optimization 
problems and is, therefore, a particular instance of local elimination algorithm. 
It appeared in 1961 with Aris [3] (see [TT], P3], [E], ED but is poorly 
known to the optimization community. This approach is used in Artificial 
Intelligence under the names "Variable Elimination" or "Bucket Elimination" 
[32] , NSDP being a natural and general decomposition approach to sparse 
problems solving, considers a set of constraints and an objective function as 
recursively computable function [58j . This allows to compute a solution in 
stages such that each of them uses results from previous stages. This requires 
a reduced effort to find the solution. 

Thus, the DP algorithm can be applied to find the optimum of the entire 
problem by using the connected optimizations of the smaller DO subproblems 
with the aid of existing optimization solvers. 

It is worth noting that NSDP is implicit in Hammer and Rudeanu's "basic 
method" for pseudoboolean optimization [52]. Crama, Hansen, and Jau- 
mard [26] discovered that the basic method can exploit the structure of a 



8 



Oleg Shcherbina 



DOP with the usage of so-called co-occurrence graph (interaction graph). 
It was found that the complexity of the algorithm depends on induced width 
of this graph, which is defined for a given ordering of the variables. Consider- 
ation of the variables in the right order may result in a smaller induced width 
and faster solution [59] . 

In [16] mostly DO problems without constraints were considered. Here, we 
consider an application of NSDP variable elimination algorithm to solving 
DO problems with constraints. 

One of the most useful graph-based interpretations is a representation 
of computational DP procedure as a direct acyclic graph (DAG) [93] whose 
vertices are associated with subproblems and whose edges express information 
interdependence between subproblems. 

Every DP algorithm has an underlying DAG structure that usually is 
implicit [30] : the dependencies between subproblems in a DP formulation can 
be represented by a DAG. Each node in the DAG represents a subproblem. 
A directed edge from node A to node B indicates that the solution to the 
subproblem represented by node A is used to compute the solution to the 
subproblem represented by node B (FigfT]). The DAG is explicit only when 
we have a graph optimization problem (say, a shortest path problem). Having 
nodes u\, . . . , Uk point to v means "subproblem v can only be solved once the 
solutions to Mi, . . . , Uk are known" (Fig. [2]). Thus, the DP formulation can 



be described by the DAG of the computational procedure of a DP algorithm 
(underlying DAG [30]). Li & Wah jlOO] proposed to classify various DP 
computational procedures or DP formulations on the basis of the dependencies 
between subproblems from the underlying DAG. 

The nodes of the DAG can be organized into levels such that subprob- 
lems at a particular level depend only on subproblems at previous levels. In 
this case, the DP procedure (formulation) can be categorized as follows. If 
subproblems at all levels depend only on the results of subproblems at the 
immediately preceding levels, the procedure (formulation) is called a serial 
DP procedure (formulation), otherwise, it is called a nonserial DP procedure 
(formulation) . 

Example 1. The simplest optimization problem is the serial unconstrained 
discrete optimization problem [16] 




Fig. 1. Precedence of subproblems A and B. 
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Fig. 2. Underlying DAG of subproblems. 

xnaxf(X) = max^ ft(X l ), 

where X = {x\, . . . , x n } is a set of discrete variables. 

K = {l,2,...,n-1}; X 1 = {xi,x i+1 }. 
In fig. [3] it is shown an interaction graph of the serial DO problem. 

C*D — C^)~ • • • - (*^) — 

Fig. 3. Interaction graph for the serial formulation of unconstrained DOP. 

4.2 Discrete optimization problem with constraints 

Consider the DOP 0, iJSJ), (O and suppose without loss of generality that 
variables are eliminated in the order x%, . . . , x n . Using the local variable elim- 
ination scheme eliminate the first variable x\. x\ is in a set of constraints with 
the indices in XJ\\ 

U 1 = {i\x 1 e 
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Together with X\, constraints in U\ contain variables from Nb{x\). 

The following subproblem P x corresponds to the variable X\ of the DOP: 

h Xl (Nb(xi)) = max{ciXi|Ajs i X5 i <bi, i G Ui, Xj = 0, 1, xj £ Nb[xi]} 

XI 

Then the initial DOP can be transformed in the following way: 

max j y] C N X N \A iSt X Si <h, i e M, Xj = 0, 1, j e ivj = 

max {C N _ {1] X N _ {1} +h xl (Nb(xi)\A lSi X Sz <b,, ieM-U 1} Xj =0,1, j = 2, . 

The last problem has n — 1 variables; from the initial DOP were excluded 
constraints with the indices in U± and from the objective function the term 
c\x\; there appeared a new objective function term h Xl (Nb(xi)). Due to this 
fact the interaction graph associated with the new problem is changed: a 
vertex x\ is eliminated and its neighbors have become connected (due to the 
appearance a new term h Xl {Nb{x\)) in the objective). It can be noted that 
a graph induced by vertices of Nb(x±) is complete, i.e. is a clique. Denote 
the new interaction graph G 1 and find all neighborhoods of variables in G 1 . 
NSDP eliminates the remaining variables one by one in an analogous manner. 
We have to store tables with optimal solutions at each stage of this process. 
At the stage n of the described process we eliminate a variable x n and find 
an optimal value of the objective function. Then a backward step of the local 
elimination procedure is performed using the tables with solutions. 

4.3 Elimination game, combinatorial elimination process, and 
underlying DAG of the LAE computational procedure 

Consider a sparse discrete optimization problem (Q]) — ([3|) whose structure is 
described by an undirected interaction graph G = {X, E) . Solve this problem 
with a local elimination algorithm (LEA) . LEA uses an ordering a of A [84] : 
Given a graph G = (X, E) an ordering a of X is a bijection a : X «-> 
{1, 2, . . . , n} where n — \X\. 

G a and X a are correspondingly an ordered graph and an ordered vertex set. 
Sometimes the ordering will be denoted as x±, . . . , x n , i.e. a(xi) = i and i will 
be considered as an index of the vertex x,,. 

In G a , a monotone neighborhood Nb G (xi) ([TS], [84]) of xt G X is a 
set of vertices monotonely adjacent to a vertex Xi, i.e. 

M>c:( x i) = i x 3 6 Nb G (xi)\j > i}. 
The graph G x [5S] obtained from G = (X, E) by 

(i) adding edges so that all vertices in Nbc(x) are pairwise adjacent, and 

(ii) deleting x and its incident edges 
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is the x-elimination graph of G. This process is called the elimination of 

the vertex x. 

Given an ordering X\, x%, . . . , x„, the LEA proceeds in the following way: 
it subsequently eliminates xi, X2, ■ ■ ■ , x n in the current graph and computes 
an associated local information about vertices from h Xi (Nb(xi)) |94|. This can 
be described by the combinatorial elimination process 85j: 



where Gj is the Xj -elimination graph of Gj_i and G n = 0. 

The process of interaction graph transformation corresponding to the 
LEA scheme is known as Elimination Game which was first introduced 
by Parter [80] as a graph analogy of Gaussian elimination. The input of the 
elimination game is a graph G and an ordering a of G (i.e. a(x) = i if x is i-th 
vertex in the ordering a) . Elimination Game according to [53J consists in the 
following. At each step i, the neighborhood of vertex Xi is turned into a clique, 
and Xi is deleted from the graph. This is referred to as eliminating vertex Xj. 
We obtain a graph G x 1 }- The filled graph G+ = (X, E+) is obtained by adding 



to G all the edges added by the algorithm. The resulting filled graph G+ is a 
triangulation of G (FULKERSON & GROSS [44]), i.e., a chordal graph. 




Let us introduce the notion for the elimination tree (etree) [67]. Given 
a graph G = (X, E) and an ordering a, the elimination tree is a directed 

tree T a that has the same vertices X as G and its edges are determined by a 
parent relation defined as follows: the parent x is the first vertex (according 
to the ordering a) of the monotone neighborhood Nb G + (x) of x in the filled 
graph G+- 

Using the parent relation introduced above we can define a directed filled 
graph G + . 

The underlying DAG of a local variable elimination scheme can be constructed 
using Elimination Game. At step i, we represent the computation of the func- 
tion hx^NbCx.^ {xi)) as a node of the DAG (corresponding to the vertex Xi). 

Then, this node containing variables (xi,Nb^ ^ (xi)) is linked with a first 

Xj (accordingly to the ordering a) which is in Nb r (i-i)(xi). 

It is easy to see that the elimination tree is the DAG of the computational 
procedure of the LEA. 

Example 2. Consider a DOP (P) with binary variables: 

2xx + '3x2 + X3 + 5x4 + 4x5 + 6x6 + x-j — > max 



— (_r, Lrl, . . . , Lrj", . . . , (_r., 



n 




3xi + 4x2 + x 3 

2.X2 + 3.X3 + 3x4 
2x 2 -i 
2x 3 

Xj =0,1, j = l,...,7. 



+ 3x 5 



+ 3x 6 + 2x7 



< 5 



< 6 



< 5 



< 4 



(Gi) 
(G 2 ) 
(G 3 ) 
(G 4 ) 
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The interaction graph is shown in Fig. 3] (a). Elimination Game results and 
graphs Gx- are in Fig. [5] Associated underlying DAG of NSDP procedure for 
the variable ordering {xq, X2,x%,X4, X3, xe, 2:7} is shown in Fig. |4] (b). 





<^^(x 1 ,x 3 ,x 4 



(a) 



(b) 



Fig. 4. Elimination tree of the DOP (a) Computing the information while elimi- 
nating variables in the LEA computational procedure (b) (example 



4.4 Bucket elimination 

Bucket elimination (BE) is proposed in [35] as a version of NSDP for solving 
CSPs. Now, we consider a modification of the BE algorithm for solving DOPs. 
The BE algorithm works as follows: Assume we are given an order x\, . . . , x n 
of the variables of the DOP. BE starts by creating n "buckets", one for each 
variable Xj. BE algorithm uses as input ordered set of variables and a set 
of constraints. To each variable Xj is corresponded a bucket S^ Xj \ i.e., a set 
of constraints and components of objective function built as follows: In the 
bucket £( x ^ of variable Xj we put all constraints that contain Xj but do 
not contain any variable having a higher index. We now iterate on j from 
n to 1, eliminating one bucket at a time. Algorithm finds new components 
of the objective applying so called "elimination operator" (in our case the 
latter consists on solving associated DO sub-problems) to all constraints and 
components of the objective function of the bucket under consideration. New 
components of the objective function reflecting an impact of variable Xj on 
the rest part of the DO problem, are located in corresponding lower buckets. 
Consider an application of BE to solving the DOP with constraints from 
Example^ We use an elimination ordering a : {x$, x%, (£1,2:4), £3, (xq, £7)}. 
Variables (x%, X4) shall be eliminated in block since they arc indistinguishable. 
Build buckets (subsets of constraints) beginning from last (due order a) block 
(x6, X-;). A bucket E^ x<i,X7 ^ includes all constraints of the DOP containing the 
variables x§, x-j, i.e., the bucket S^ Xe ' X7 ' consists of constraint C4: S^ X6 ' X7 ^ — 
{d}. Similarly: = {C u C 2 }, S( x ^ x ^ = 0, E {x ^ = {C 3 }, = 0. 
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a) Initial interaction 
graph; 




c) after elimination x, ; 




e) after elimination x 4 ; 

« © 

g) after elimination x b 





b) after elimination x s ; 



" © 

d) after elimination x, ; 





f) after elimination x 3 . 




i) Directed filled graph G„ . 
h) Filled graph G* . 

Fig. 5. Elimination Game. Fill-in is represented by dashed lines 

We solve a DO subproblem associated with the bucket jj^ Xe ' X7 ^: 
For each binary assignment x 3 , we compute values x 6} x 7 such that 



h X6 ,x T {%3) = max{6x 6 + x 7 \ 2x 3 + 3x 6 + 2x 7 < 5, Xj e {0, 1}}. 

x 6 ,x 7 
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Table 2. 

Calculation of h X3 {x\, x 2 , X4) 



Table 1. 

Calculation of h Xfj , Xl {xz) 



x\ x 2 X4 



h. 



x?, 



h. 



1 1 
1 





1 

1 

1 1 

1 
1 1 
1 1 

1 1 1 



The function /i X6 ,x 7 (2:3) is placed in the bucket S^ X3 \ Consider the DO sub- 
problem associated with this bucket 

h X3 (x 1 ,x 2 ,x 4 ) = max[ x 3 + h X6X7 (x 3 )] 

3x 1 + Ax 2 + x 3 < 6, 

2x 2 + 3^3 + 3x4 < 5, 
x 3 ■ =0,1, .7 = 1,2,3,4. 

We place the function h X3 (xi, x 2 , £4) in the bucket Z'^ 1 ' 14 ' and solve the 
problem 

h xl , X4 (x 2 ) = max{2xx + 5x 4 + h X3 (x 1 ,x 2 ,x 4 ) \ xj £ {0, 1}}. 

Build the corresponding table 3. 

Function h XliXl {x 2 ) is placed in the bucket S^ X2 \ A new DO subproblem 
left to be solved 



h X2 (x 5 ) = max{3x 2 + h XliX4 (x 2 ) \ 2x 2 + 3x 5 < A,Xj £ {0, 1}} 

Table 4. 

. >. Xi (x 2 ) Calculation of h X2 (x 5 ) 



Table 3. 

Calculation of h 



x 2 



X5 



14 
12 



1 1 
1 



15 
14 



Place h X2 (x 5 ) in the last bucket E^ X5 \ The new subproblem is: 
h X5 = max{4x 5 + h X2 (x 5 ) \ Xj £ {0, 1}}, 

its solution is /15 = 18, X5 = 1 and the maximal objective value is 18. 



Local Elimination Algorithms 15 



To find the optimal values of the variables, it is necessary to do backward 
step of the BE procedure: from the last table 4 using x 5 = 1 we have x\ — 0. 
Considering the table 3 we have for x% = Q : x* = 1, x% = 1. From the table 
2: xx = 1, £ 2 = 0j ^4 = 1 =>■ x 3 = 0- Table 1: x 3 = =>• a;g = 1, = 1. 
The solution is (1, 0, 0, 1, 1, 1, 1), optimal objective value is 18. 

5 Block local elimination scheme 

5.1 Partitions, clustering, and quotient graphs 

The local elimination procedure can be applied to elimination of not only 
separate variables but also to sets of variables and can use the so called " elim- 
ination of variables in blocks" ([16). [50]). which allows to eliminate several 
variables in block. Local decomposition algorithm [5U] actually implements 
the local block elimination algorithm. If the DOP is divided into blocks cor- 
responding to subsets of variables (meta- variables), then block structure can 
be described with the aid of a structural condensed graph whose meta-nodes 
correspond to subsets of the variables or blocks and meta-edges correspond 
to adjacent blocks. 

Applying the method of merging variables into meta-variables allows to 
obtain condensed or meta-DOPs which have a simpler structure. If the re- 
sulting meta-DOP has a nice structure (e.g., a tree structure) then it can be 
solved efficiently. 

The structural graph of the meta-DOP is obtained by collapsing merged 
nodes into a single meta-node and connecting the meta-node with all nodes 
that were adjacent with some of the merged nodes. Such a graph usually is 
called a quotient graph. 

An ordered partition of a set X is a decomposition of X into ordered sequence 
of pairwise disjoint nonempty subsets whose union is all of X. 
Partitioning is a fundamental operation on graphs. One variant of it is to 
partition the vertex set X to three sets X = U U S U W, such that U and 
W are balanced, meaning that neither of them is too small, and S is small. 
Removing S along with all edges incident on it separates the graph into two 
connected components. S is called a separator. In general, graph partitioning 
is A^P-hard. Since graph partitioning is difficult in general, there is a need for 
approximation algorithms. A popular algorithm in this respect is MeTiS |70) . 
which has a good implementation available in the public domain. 

Taking advantage of indistinguishable variables (two variables are indis- 
tinguishable if they have the same closed neighborhood PQ, [7], [54], [8]) it is 
possible to compute a quotient (condensed) graph which is formed by 
merging all vertices with the same neighborhoods into a single meta-node. 
Let x be a block of a graph G [5], i.e., a maximal set of indistinguishable 
with v vertices. Clearly, the blocks of G partition X since indistinguishability 
is an equivalence relation defined on the original vertices. 
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An equivalence relation on a set induces a partition on it, and also any 
partition induces an equivalence relation. Given a graph r = (X,E), let 
X be a partition on the vertex set X: 

X = {xi,x 2 , . . • ,x m }. 

That is, U™ j^Xj = X and Xj n Xk = for i ^ k. We define the quotient 
graph of G with respect to the partition X to be the graph 

G/X= (X,£), 

where (xi, Xk) S £ if and only if 7V&c(xi) Pi Xk i= 0. 

The quotient graph G(X, £) is an equivalent representation of the inter- 
action graph G(X,E), where X is a set of blocks (or indistinguishable sets 
of vertices), and £ C X x X be the edges defined on X. A local block 
elimination scheme is one in which the vertices of each block are eliminated 
contiguously [5]. As an application of a clustering technique we consider be- 
low a block local elimination procedure [TB] where the elimination of the block 
(i.e., a subset of variables) can be seen as the merging of its variables into a 
meta-variable. 

The merges done define a so called synthesis tree [102] on the variables. 

Definition 4. A synthesis tree of an initial DOP P is a tree whose leaves 
correspond to the variables of the initial DOP P , and where each intermediate 
node is a meta-variable corresponding to the combination of its children nodes. 

Using the synthesis tree it is possible to " decode" meta- variables and find the 
solution of the initial DOP. 

Consider an ordered partition X of the set X of the variables into blocks: 

X = (xi, . . . ,x p ), p<n, 

where xi = Xk { (Ki is a set of indices corresponding to xi, I — 1, ... ,p). For 
this ordered partition X, the DOP P: 0, ©, © can be solved by the LEA 
using quotient interaction graph G. 

A. Forward part 

Consider first the block xi. Then 

m&x{C N X N \Ais z X Si < bi, i e M, Xj = 0, 1, j E N} — 

X 

max {C N - Kl X N - Kl + h 1 {Nb(X K± )\A iSi X Si < b u i&M- U u 

Xk 2 , - ,Xk p 

asj = 0, 1, j <E N - K{\ 
where Ut = {i : Si H ifi ^ 0} and 



}n(Nb{X Kl )) = max{C Kl X Kl \A iSi X Si < b u i e U x , x 3 = 0,1, x 3 e JVbfxi]}. 

Xk 1 
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The first step of the local block elimination procedure consists of solving, 
using complete enumeration of X^ 1 , the following optimization problem 

hx{Nb{X Kl )) = max{C Kl X Kl \A lSt X Sl < h, i € U u x 3 = 0, 1, x 3 € Nb[x x }}, 

(8) 

and storing the optimal local solutions Xj^ x as a function of the neighborhood 
ofX Kl ,Le.,X* Ki (Nb(X Kl )). 

The maximization of f(X) over all feasible assignments Nb(XK 1 ), is called 
the elimination of the block (or meta- variable) Xk-i- The optimization 
problem left after the elimination of Xk x is: 

max {C N - Kl X N - Kl + hi(Nb(X Kl ))\A iSi Xs i < b u i e M - U u 

X—Xk 1 

=0,1, j eN-Kx}. 

Note that it has the same form as the original problem, and the tabular 
function h\(Nb(XK 1 )) may be considered as a new component of the modified 
objective function. Subsequently, the same procedure may be applied to the 
elimination of the blocks - meta- variables X2 = Xk 2 , . . . , x p = Xk p , in turn. 
At each step j the new component h x . and optimal local solutions X^. are 
stored as functions of Nb(XKj \ Xk i: ■ ■ ■ , Xk^x), i.e., the set of variables 
interacting with at least one variable of Xr . in the current problem, obtained 
from the original problem by the elimination of Xfc ± , . . . , Xr Since the 
set Nb(Xx | Xk i; ■ ■ ■ ,Xk _ 1 ) is empty, the elimination of X^ yields the 
optimal value of objective f(X). 

B. Backward part. 

This part of the procedure consists of the consecutive choice of X* K , 
Xk _ ,...,Xft , i.e., the optimal local solutions from the stored tables 
X* K l(Nb(X Kl ) ), X* K2 (Nb(X K2 \X Kl )),...,X* Kp \X Kp _ 1 ,...,X Kl . 
Block elimination game and underlying DAG 

It is possible to extend EG to the case of the block elimination. The 
input of extended EG is an initial interaction graph G and a partition 
X = {x!, . . . ,x p } of vertices of G. At each step v (1 < v < p) of EG, the 
neighborhood Nb(x. v ) of x„ is turned into a clique, and x u is deleted from the 
graph G. The filled graph = (X, E + ) is obtained by adding to G all the 
edges added by the algorithm. The resulting filled graph is a triangulation 
of G, i.e., a chordal graph [6]. 

Underlying DAG of the local block elimination procedure contains nodes 
corresponding to computing of functions h Xi (Nb n (i-i) (xi)) and is a general- 
ized elimination tree. 

Example 3. Local block elimination for unconstrained DOP. 

Consider an unconstrained DOP 



max[/i(xi,X2,x 3 ) + f 2 {x 2 , x 3 , x 4 ) + f 3 (x 2 ,x 5 ) + fi(x 3 ,x 6 ,x 7 )], 
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where 

X = (x 1 ,x 2 ,x 3 ,x 4 ,x 5 ,x 6 ,x 7 ) 
and functions fx, /a, /3, fi are given in the following tables. 
Table 5. ft Table 6. f 2 



XI X2 



X3 | fl 












2 








1 


3 





1 





4 





1 


1 





1 








5 


1 





1 


2 


1 


1 





4 


1 


1 


1 


1 



Xl X2 X 3 \j2 












3 








1 


1 





1 





5 





1 


1 


2 


1 








4 


1 





1 


1 


1 


1 





3 


1 


1 


1 






Table 7. / 3 
x 2 x 5 \f 3 \ 






G 


1 


2 


1 


4 


1 1 


5 



Table 8. / 4 
£3 x e X 7 \f4 












5 








1 


2 





1 





3 





1 


1 


4 


1 








2 


1 





1 


1 


1 


1 





3 


1 


1 


1 


G 



Consider an ordered partition of the variables of the set into blocks: 
xi = {x 5 }, x 2 = {afi, X2,%i}, x 3 = {x 6 ,x 7 }, x 4 = {x 3 }. 

Interaction graph for this problem is the same as in Fig. [4] (a) . 

For the ordered partition X = {xi, x 2 , X3, X4}, this unconstrained DO 
problem may be solved by the LEA. Initial interaction graph with partition 
presented by dashed lines is shown in Fig. [S] (a), quotient interaction graph 
is in Fig. [5] (b), and the DAG of the block local elimination computational 
procedure is shown in Fig. [71 

A. Forward part 

Consider first the block xi = {X5}. Then TVfe(xi) = {X2}. Solve using 
complete enumeration the following optimization problem 



(A6(xi)) = max 73(22, £5), 

X5 
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X4 



X3 




^*2 = fa. *2,xJ^ 





Fig. 6. Interaction graph of the DOP with partition (dashed) (a) and quotient 
interaction graph (b) (example [3}. 





km) 



Fig. 7. The DAG (generalized elimination tree) of the local block elimination com- 
putational procedure for the DO problem (example [3} • 



and store the optimal local solutions xi as a function of a neighborhood, i.e., 
Xl *(JV6( Xl )). 

Eliminate the block xx and consider the block x 2 = {x\, x 2 , £4}. 7V6(x 2 ) = 
{£3}. Now the problem to be solved is 

h* 2 {x 3 ) = max {h Xl (x 2 ) + /i(xi, x 2l x 3 ) + fa{xi, x 3 , x 4 )}. 

Build the corresponding table 10. 

Table 9. Table 10. 

Calculation of /i Xl (x 2 ) Calculation of /i X2 (^3) 



3'2 



h Xl {x 2 )\a 



xz\h^(x 3 )\x\ x* 2 x\ 



14 
14 



1 
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Eliminate the block x 2 and consider the block x 3 = {x e ,x?}. The neighbor 
of x 3 is x 3 : Nb(x 3 ) — {x 3 }. Solve the DOP containing x 3 : 

h X3 (x 3 ) = ma,x{fi(x s ,x 6 ,x 7 ),Xj G {0,1}} 

X6,XT 

and build the table 11. 

Table 11. 

Calculation of h X3 (x 3 ) 



X3 


h Xa (x 3 ) 


: 4 


X j 





5 








1 


6 





l 



Eliminate the block x 3 and consider the block X4 = {x 3 }. Nb(x.4) — 0. Solve 
the DOP: 

h X4 = max{h X2 (x 3 ) + h Xa (x 3 ),Xj 6 {0, 1}} = 20, 

where x 3 = 1. 

B. Backward part. 

Consecutively find x 3 *,X2*,Xi*, i.e., the optimal local solutions from the 
stored tables 11, 10, 9: 
x 3 = 1 =^ Xg = 1, Xj = l (table 11); 

x* 3 = 1 => x\ = 0, x* 2 = 0, x% = (table 10); = =>• ^ = (table 9). 
We found the optimal solution to be (0, 0, 1, 0, 0, 1, 1), the maximum 
objective value is 20. 

Example 4- Local block elimination for constrained DOP 

Consider the DOP from example[2]and an ordered partition of the variables 
of the set into blocks: 

xi = {^5}, x 2 = {xx,X2,X4,}, x 3 = {x 6 ,x 7 }, x 4 = {x 3 }. 

For the ordered partition {xi, x 2 , x 3 , X4}, this constrained optimization 
problem may be solved by the LEA. 
A. Forward part 

Consider first the block xi = {X5}. Then A6(xi) = {£2}. Solve the fol- 
lowing problem containing X5 in the objective and the constraints: 

h^JNbtxx)) = max{4x 5 | 2x 2 + 3x 5 < 4,Xj e {0, 1}} 

is 

and store the optimal local solutions Xi as a function of a neighborhood, 
i.e., Xi*(Afe(xi)). Eliminate the block Xi. and consider the block x 2 = 
{xi,X2,X4,}. Nb(x 2 ) = {x 3 }. Now the problem to be solved is 
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^x 2 (#3) = max {h Xl (x 2 ) + 2x\ + 3x 2 + 5x 4 } 

X\ ,X2 ,X4 

subject to 

3a; 1 + Ax 2 + x 3 < 6, 

2x 2 + 3x 3 + 3x 4 < 5, 

^• = 0,1, j = 1,2,3,4. 

Build the corresponding table 13. 

Table 12. Table 13. 

Calculation of h Xl (x 2 ) Calculation of h X2 (x 3 ) 



x 2 



h Xl (x 2 )\x* 5 



x 3 



h X2 (x 3 ) 



4 




11 

6 



1 1 
1 



Eliminate the block x 2 and consider the block X3 = {xq,x 7 }. The neighbor 
of X3 is x 3 : Nb(xs) — {x 3 }. Solve the DOP containing x 3 : 



h X3 (x 3 ) = max X6;X7 {/i x , 
and build the table 14. 



X3 



6x fi 



x 7 I 2x 3 + 3x@ + 2x 7 < 5, Xj e {0, 1}} 



Table 14. 

Calculation of /i x 



1(^3) 



X3 


h X3 (x 3 ) 


x% 


x* 7 





18 


1 


1 


1 


12 


1 






Eliminate the block X3 and consider the block X4 = {2:3}. Nb(x.4) — 0. Solve 
the DOP: 



max{h XL3 (x 3 ),x j e {0,1}} = 18, 

X3 



where x 3 



0. 



B. Backward part. 

Consecutively find x 3 *,x 2 *,xi*, i.e., the optimal local solutions from the 
stored tables 14, 13, 12. x* 3 = => x% = 1, x* 7 = 1 (table 14); x* 3 = x\ = 
1, x* 2 = 0, x\ = 1 (table 13); 2^ = => = 1 (table 12). We found the 
optimal global solution to be (1, 0, 0, 1, 1, 1, 1), the maximum objective 
value is 18. 



6 Tree structural decompositions in discrete 
optimization 

Tree structural decomposition methods use partitioning of constraints and use 
as a meta-tree a structural graph . Dynamic programming algorithm starts 
at the leaves of the meta-tree and proceeds from the smaller to the larger 
subproblems (corresponding to the subtrees) that is to say, bottom-up in the 
rooted tree. 
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6.1 Tree decomposition and methods of its computing 

Aforementioned facts and an observation that many optimization problems 
which are hard to solve on general graphs are easy on trees make detection 
of tree structures in a graph a very promising solution. It can be done with 
such powerful tool of the algorithmic graph theory as a tree decomposition 
and the treewidth as a measure for the "tree- likeness" of the graph [53]. It 
is worth noting that in [56] is discussed a number of other useful parameters 
like branch-width, rank-width (clique-width) or hypertree- width. 

Definition 5. Let G = (X, E) be a graph. A tree decomposition of G is a 

pair (T; Y) with T = (I; F) a tree and Y = {yi \ I <E 1} a family of subsets 
of X , one for each node of T , such that 

• (ii) for every edge (x, y) € X there is an i I with x G yi, y G yi, 

• (Hi) (intersection property) for all i, j, I £ /, if i < j < I, then yifiyi C yj . 

Note that tree decomposition uses partition of constraints, i.e., it can be con- 
sidered as a dual structural decomposition method. The best known complex- 
ity bounds are given by the "treewidth" tw (Robertson, Seymour [83] ) 
of an interaction graph associated with a DOP. This parameter is related to 
some topological properties of the interaction graph. Tree decomposition and 
the treewidth (Robertson, Seymour [83]) play a very important role in 
algorithms, for many ./VP-complete problems on graphs that are otherwise 
intractable become polynomial time solvable when these graphs have a tree 
decomposition with restricted maximal size of cliques (or have a bounded 
treewidth [6], [20], [21]). It leads to a time complexity in 0(n ■ 2 tw+1 ). Tree 
decomposition methods aim to merge variables such that the meta-graph is a 
tree of meta- vertices. 

The procedure to solve a DO problem with bounded treewidth involves two 
steps: (1) computation of a good tree decomposition, and (2) application of a 
dynamic programming algorithm that solves instances of bounded treewidth 
in polynomial time. 

Thus, a tree decomposition algorithm can be applied to solving DOPs 
using the following steps: 

(i) generate the interaction graph for a DOP (P); 

(ii) using an ordering for Elimination Game add edges in the interaction graph 
to produce a (chordal) hlled graph; 

(hi) build the elimination tree and information flows (see Fig 4(b)); 

(iv) identify the maximum cliques, apply an absorption and build subproblems; 

(v) produce a tree decomposition; 

(vi) solve the DO subproblems for each meta-node and combine the results 
using LEA. 

As finding an optimal tree decomposition is AP-hard, approximate optimal 
tree decompositions using triangulation of a given graph are often exploited. 
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Let us list existing methods of computing tree decomposition using a survey of 
them in [BTJ. Optimal triangulations algorithms have an exponential time 
complexity. Unfortunately, their implementations do not have much interest 
from a practical viewpoint. For example, the algorithm described in [41) has 
time complexity 0(n 4 • (1.9601")) [6TJ. A paper [46] has shown that the algo- 
rithm proposed in [96] cannot solve small graphs (50 vertices and 100 edges). 
The approach of [46j using a branch and bound algorithm, seems promising 
for computing optimal triangulations. Approximation algorithms approx- 
imate the optimum by a constant factor. Although their complexity is often 
polynomial in the treewidth [2], this approach seems unusable due to a big 
hidden constant. Minimal triangulation computes a set C such that, for 
every subset C C C , the graph G = (X, C U C ) is not triangulated. The 
algorithms LEX-M [84] and LB [17] have a polynomial time complexity of 
0(ne ) with e the number of edges in the triangulated graph. Heuristic tri- 
angulation methods build a perfect elimination order by adding some edges 
to the initial graph. They can be easily implemented and often do this work 
in polynomial time without providing any minimality warranty. In practice, 
these heuristics compute triangulations reasonably close to the optimum 64J . 
Experimental comparative study of four triangulation algorithms, LEX-M, 
LB, min-fill and MCS was done in [BT]. Min-fill orders the vertices from 1 
to n by choosing the vertex which leads to add a minimum number of edges 
when completing the subgraph induced by its unnumbered neighbors. Paper 
[BT] claims that LB and min-fill obtain the best results. 

6.2 Computing tree decompositions for NSDP schemes 

Given a triangulated (or chordal) graph, the set of its maximal cliques cor- 
responds to the family of subsets associated with a tree decomposition (so 
called clique tree [U]). When we exploit tree decomposition, we only con- 
sider approximations of optimal triangulations by clique trees. Hence, the time 
complexity is then 0(n -2 W +1 ) (w + 1 < w + + 1 < n). The space complexity 
is 0{n ■ s ■ 2 s ) with s the size of the largest minimal separator 61J. 
Usually, tree decomposition is considered in the literature separately from 
NSDP issues. But there is a close connection between these two structural de- 
composition approaches. Moreover, it is easy to see that a tree decomposition 
can be obtained from the DAG of the computational NSDP procedure (this 
fact was noted in [63]). 

Consider example [2] and build a tree decomposition associated with the 
corresponding NSDP procedure. Associated underlying DAG of NSDP proce- 
dure for the variable ordering {x$,X2, £4, X3, Xq, X7} is shown in Fig. [4] (b). 
As was mentioned above, this underlying DAG of local variable elimination 
(the elimination tree) is constructed using Elimination Game. A node i of 
the DAG is containing variables (ai, Nb^" 1 ^ (a;*)) is linked with the first xj 
(accordingly to the ordering a) which is in Nb G a-i)(xi). Nodes and edges of 
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desired tree decomposition correspond one-by-one to nodes and edges of the 
underlying DAG. Each node of the tree decomposition is indeed a meta-node 
containing a subset of vertices of the interaction graph G. This subset induces 
a subgraph in G that was condensed to generate the meta-node. Restore these 
subgraphs for each meta-node of the tree decomposition. 

Proposition 1. Graph structure obtained by this construction from the un- 
derlying DA G of the NSDP procedure is a tree decomposition. 

Proof is in [55] , 

In our example [H we observe that the first (accordingly to ordering a) meta- 
node corresponds to the variable x§ and contains variables (vertices) xi , x§ 
(i.e., x§ U Nb(xs)). Subgraph induced by these vertices can be constructed us- 
ing the interaction graph G (Fig. 2] a). This subgraph is shown in Fig. 8 (a) — 
the meta-node yi . Next meta-node y2 of the tree decomposition corresponds 
to the variable X2 and contains variables x%, X2, x%, X4. The corresponding 
induced subgraph (clique) is shown inside the meta-node y2 in Fig. 9 (a). 
Continuing in analogous way we obtain the tree decomposition as shown in 
Fig. 8 (a). 

It is easy to see that some cliques in this tree decomposition are not maximal 
and can be absorbed by other cliques. In the case, when one clique contains 
another clique, the second clique can be absorbed into the first one. Thus, the 
clique corresponding to the meta-node y2 is absorbed by clique y3 (we denote 
a result of absorption as a clique y2,3- The clique y$ is absorbed by clique 
y 4 forming a clique y4,s. After absorptions done we obtain a clique tree (Fig. 
8 (b)) containing only maximal cliques. These maximal cliques correspond 
to constraints of the DOP. In Fig. 8 (b) maximal cliques and links between 
them are shown. Local decomposition algorithm [90] that uses a dynamic pro- 
gramming paradigm can be applied to this clique tree. Other possible way of 
finding the clique tree is using maximal spanning tree in the dual graph. 



6.3 Applying the local decomposition algorithm to solving DO 
problem 

To describe how tree decompositions are used to solve problems with the 
local decomposition algorithm, let us assume we find a tree decomposition of 
a graph G. Since this tree decomposition is represented as a rooted tree T, the 
ancestor/descendant relation is well-defined. We can associate to each meta- 
node y the subgraph of G made up by the vertices in y and all its descendants, 
and all the edges between those vertices. Starting at the leaves of the tree T, 
one computes information typically stored in a table, in a bottom-up manner 
for each bag until we reach the root. This information is sufficient to solve the 
subproblem for the corresponding subgraph. To compute the table for a node 
of the tree decomposition, we only need the information stored in the tables 
of the children (i.e. direct descendants) of this node. The DO problem for the 
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entire graph can then be solved with the information stored in the table of 
the root of T. Consider example and exploit the tree decomposition (clique 
tree) shown in Fig. 8 (b). Let us solve the subproblem corresponding to the 
block yi. Since this block is adjacent to the block y2,3, we have to solve a 
DOP with variables yi — y2,3 for all possible assignments yip|y2,3- Thus, 
since yi — y2.3 = {^5} and yi |"|y2,3 = {^2}, then induced subproblem has 
the form: 

^1(^2) = max{4x 5 } 

subject to 

2x 2 + 3x 5 < 4, xj = 0, 1, j e {2, 5} 
Solution of the problem can be written in a tabular form (see table 15). 
Table 15. Table 16. 



Calculation of h yi (x2) Calculation of h y2 a {x^) 



X2 


h yi 


x^(x 2 ) 




■'•3 


^y2,3 


X\{X 3 ) X^(x 3 ) X^(x 3 ) 





4 


1 







11 


1 1 


1 










1 


6 


1 



Since y 2 ,3-y4 = {xi, x 2 , x 3 , x 4 } - {x 3 , x 6 , x 7 } = {xi,x 2 ,x 4 } and y 2 ,3f|y4 = 
{x 3 }, next subproblem corresponding to the leaf (or meta-node) y 2 .3 of the 
clique tree is 



2G 
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Forming a maximal 
clique by absorption 




(b) 

Fig. 8. Tree decomposition for the NSDP procedure (example [2]) before (a) 

and after absorption (b). 
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h y23 (x 3 ) = m a x {h yi + 2xi + 3x 2 + 5x4} 

Xl,X2,X4 

subject to 

3xi + 4a; 2 + x 3 < 6, 2x 2 + 3x 3 + 3x 4 < 5, Xj = 0, 1, j £ {1, 2, 3, 4} 

Solution of this subproblem is in table 16. The last problem corresponding to 
the block y 4i5 left to be solved is: 

h yA 5 = max {h y2 3 (x 3 ) + x 3 + 6x 6 + x 7 | 

£c 3 ,a: 6 ,a; 7 

S.t. 

2x 3 + 3x 6 + 2x 7 < 5, x-j = 0, 1, j e {3, 6, 7} 
Table 17. Calculation of h v . , 





X3 Xg X7 


18 


1 1 



The maximal objective value is 18. To find the optimal values of the variables, 
it is necessary to do a backward step of the dynamic programming procedure: 
from table 17 we have xj = 0, Xg = 1, x 7 = 1. From the table 16 using the 
information xj = we find x\ = 1, x\ — 0, x\ — 1. Considering table 15 
we have for x\~^): x\ = 1. The solution is (1, 0, 0, 1, 1, 1, 1); the maximal 
objective value is 18. 



7 Conclusion 

This paper reviews the main graph-based local elimination algorithms for 
solving DO problems. The main aim of this paper is to unify and clarify the 
notation and algorithms of various structural DO decomposition approaches. 
We hope that this will allow us to apply the aforementioned decomposition 
techniques to develop competitive algorithms which will be able to solve prac- 
tical real- life discrete optimization problems. 
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